Module 13: Local Optimization Algorithms and Neural Networks

Homework

Homework 7 is due in two weeks, Sunday at midnight

Learning Objectives

• Neural Network Learning and Backpropagation
• Gradient Descent
• Newton’s Method
• Convergence Rates and Condition Number
• Acceleration Using Momentum

Readings

Chapter 9 of Convex Optimization

Chapter 8.1-8.4 of Introduction to Algorithms for Data Mining Machine Learning

Or alternatively deeplearningbook Chapter 6